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Abstract. In this paper we consider the iteratively regularized Gauss-Newton 
method for solving nonlinear ill-posed inverse problems. Under merely Lipschitz 
condition, we prove that this method together with an a posteriori stopping rule 
defines an order optimal regularization method if the solution is regular in some 
suitable sense. 
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1. Introduction 

In this paper we will consider the nonlinear inverse problems which can be formulated 
as the operator equations 

F(x)=y, (1.1) 

where F : D(F) C X — > Y is a nonlinear operator between the Hilbert spaces X 
and Y with domain D(F) and range R(F). Such problems arise naturally from the 
parameter identification in partial differential equations. For instance, consider the 
identification of the parameter c in the boundary value problem 

f -Am + cu = f inn , . 

\ tt = on9^ 1 ' 

from the measurement of the state u, where fl C R n , n < 3, is a bounded domain 
with smooth boundary dfl, and / 6 L 2 (£l). It is well known that Q1.2p has a unique 
solution u :— u(c) € H 2 (Q) C L 2 (f2) for each 

c e Z? := {c e L 2 (Q) : ||c — c|| ^^(n) < 7 f° r some c > a.e.} 

with some 7 > 0. If we define the operator F as 

F : D C L 2 {VL) -> L 2 (fi), c->tt(c), 

then the problem of identifying c is reduced to solving (jl.ip . 

Throghout this paper || • || and (•, •) will be used to denote the norms and inner 
products for the both spaces X and Y since there is no confusion. The nonlinear 
operator F is always assumed to be Frechet differentiable, the Frechet derivative of F 
at x € D(F) will be denoted as F'(x) and F'(x)* will be used to denote the adjoint of 
F'{x). We will assume that y is attainable, i.e. y S R(F). This means that problem 
(|1.1|) has a solution e D(F), that is 

F(a;t)=i/. 

We say problem ()l.ip is ill-posed if its solution does not depend continuously on the 
right hand side y, which is the characteristic property for most of the inverse problems. 
Since the right hand side is usually obtained by measurement, thus, instead of y itself, 
the available data is an approximation y s satisfying 

11/ - y\\ <6 (1.3) 

with a given small noise level <5 > 0. Then the computation of a stable solution of 
([l.ip from y 5 becomes an important issue of ill-posed problems, and the regularization 
techniques have to be taken into account. 

Tikhonov regularization is one of the well-known method that has been studied 
extensively in recent years. Several a posteriori rules have been suggested to choose the 
regularization parameter. Besides the Morozov's discrepancy principle, an a posteriori 
rule has been proposed in [5] to yield optimal rates of convergence. It has been shown 
in [H [5] that under some reasonable conditions Tikhonov regularization together with 
the rule in [5] indeed is order optimal. Moreover, it has also been proved in [B] that if 
the solution satisfies suitable source conditions, the same order optimal result is still 
true under merely Lipschitz condition on F'. 

Iteration methods are also attractive since they are straightforward to implement 
for the numerical solution of nonlinear ill-posed problems. In [T] Bakushinskii proposed 
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the iteratively regularized Gauss-Newton method in which the iterated solutions {x s k } 
arc defined successively by 

4+i =4- M + F'ixlYF'ixi))- 1 (F'(xir(F(xi) y s ) + a k {x{ - x )) , (1.4) 

where Xq :— xq is an initial guess of x^ , and {at} is a given sequence of numbers such 
that 

Oik > 0, 1 < < r and lim a>k = (1.5) 

for some constant r > 1. It has been shown in that if 

x Q -x* = (F'(a; t )*F'(s t )) l/ / 2 cj (1.6) 

for some u € X and some < f < 2, then for the stopping index Ng chosen by the a 
priori rule 

a Ns < [j^J < a t> < k < N 5 

there holds the order optimal convergence rate 

\\x 5 Ns -x^\\ < C||w|| 1 /(i+")^/(i+'') 

with some constant C independent of S. This rule, however, depends on the knowledge 
on the smoothness of xq — x\ which is difficult to check in practice. Thus a wrong 
guess of the smoothness will lead to a bad choice of Ng, and consequently to a bad 
approximation to x* ■ Therefore, a posteriori rules, which use only quantities that arise 
during calculations, should be considered to choose the stopping index of iteration. 
The generalized discrepancy principle 

- V*\\ <rS< \\F(x s k ) ~ y s \\, 0<k< n s 

has been considered in [2] as an a posteriori rule for choosing the stopping index ng, 
where t > 1 is a sufficient large number. Under certain conditions, it has been shown 
that 

ii<-^ii<o(^/( i+ ^) 

if xo — x^ satisfies (|1.6p with < v < 1. However, with such ng, one cannot expect a 
better rate of convergence than Oid 1 ' 2 ) even if xo — x' satisfies (11.6[) with v > 1. 

In order to prevent such saturation, an alternative a posteriori rule has been 
suggested in [3] to choose the stopping index kg such that kg is the first integer 
satisfying 

(F{x{ 6 )-y\{a ks I + F\xl)F\x{jr\F{x{ 5 )-y s ))<rH\ (1.7) 

where r > 1 is a large number. It has been shown that if F satisfies the condition 
that there exists a constant Kq such that for each pair x, z £ B p {x^) and w G X there 
is an element h(x, z,w) G X such that 

(F'(x) -F\z))w = F'(z)h(x,z,w) and \\h(x, z, w)\\ < K \\x - z\\ \\w\\, (1.8) 

where B p (x^) C D(F) denotes a ball of radius p > around x\ then 

||4 3 - 1*11 < (1.9) 

as long as xq — x* satisfies (jl.6j) with < v < 2. Moreover, the result in [3] implies 
the convergence rates under more general source conditions, thus it even applies to 
exponentially ill-posed problems. 
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The structure condition (|1.8p on F indeed can be verified for many inverse 
problems. However, there are still some critical cases in which this condition is 
violated. Thus it would be useful to derive some conclusions under conditions different 
from or even weaker than (|1.8p . Some numerical results reported in [3] indicates that 
the order optimal convergence rate holds if xo — x^ is smooth enough even if (|1.8p is 
not valid. In this paper we will establish some result under merely Lipschitz condition 
on F' . We will assume that 

B p {x r ) C D{F) for some p> 4\\x -x*\\ (1.10) 
and that F' satisfies the Lipschitz condition, i.e. there exists a constant L such that 

\\F'(x) - F'{z)\\ < L\\x- z\\ for all x,z G B p {x*). (1.11) 
Moreover, we will assume that the nonlinear operator F is properly scaled, i.e. 

\\F'{x)\\ < a\'\ xeB p (xi). (1.12) 

This scaling condition can always be fulfilled by multiplying the both sides of Ijl.ip 
by a sufficiently small constant, which then appears as a relaxation parameter in the 
iteratively regularized Gauss-Newton method. 

The main result of this paper is the following 

Theorem 1.1 Assume that \1.1(A) , f 1,11]) and hi. 12}) hold and that ks is determined 
by (Op with t > 2. If x - x< = F'(x^)*v for some v G Af(F' '(x^)*) 1 - C Y and if 
L\\v\\ is sufficiently small, then 

114, - a^ll < CM (\\x k - ar+ll + -L : k = 0, 1, • • J . (1.13) 



In particular, if, in addition, xq — x T = (F'(xt)*F'(xWu for some uj G X and 
some 1 < v < 2, then 

\\4 5 - x*\\ < C\\l>\\ 1 K 1+v '>S u K 1+u \ (1.14) 
where C is a constant independent of 5. 

We remark that the {xk} appearing in Theorem 11.11 is the sequence defined by 
the iteratively regularized Gauss-Newton method (|1.4p corresponding to the noise-free 
case, that is {xk} is defined successively by 

x k+ i =x k - (a k I + Ah)' 1 [F'(x k )*(F(x k ) - y) + a k (x k - x )] . 

We also remark that we will not specify the smallncss of L\\v\\ in the above result, 
one can keep track the proof to get an upper bound. The proof will make use of some 
ideas developed in [H [31 [5] . 

For ease of exposition, throughout this paper we will use the convention A < B 
to mean that A < CB for some universal constant C independent of S and k. Thus 
A « B is used to mean that A < B and B < A. 
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2. A crucial estimate on convergence rates 

Throughout this paper, we will use the notations 

A := FV)*nz + ), A := F'{x k )*F'(x k ), A{ := F'(4)*F'(4), 

B := F'(*t)^V)*, £ fc := F'(x k )F'(x k )* , B{ := ^(4)^(4)*- 

We will also use the notations 

&k - = <^k ) ^k " = 3^ • 

The following elementary result will be used frequently. 

Lemma 2.1 Let {pk} be a sequence of positive numbers satisfying < p with a 
constant p > 0. Suppose that the sequence {r/ k } has the property rj k+ i < Pk + £Vk for 
all k. If ep < 1 and r/ < j^Pq, then r\ k < jz^Pk for all k. 

The purpose of this section is to prove the following convergence rate result. 

Proposition 2.1 Assume that U.10)) , il.ll)) and 11.12\) hold and that xq — x^ = 
F'(x^)*v for some v E Af(F'(x')*) . Let ks be the integer determined by \1. 7\ ) with 
t > 2. 7/L||w|| is sufficiently small, then 

\\xi s -^\\<C\\v\\^S^, 

where C is a constant independent of 6. 

In order to prove Proposition ^. l\ we need to give an upper bound on kg. To this 
end, we introduce the integer kg which is defined to be the first integer such that 

a- kg < pj < a k , 0<k< k s . (2.1) 

where cq is a constant such that < cq < r — 2. 

Lemma 2.2 Under the conditions in Proposition \KT\ if L\\v\\ is sufficently small, 
then for all integers < k < ks there hold 

x{EB p {x^) and \\e{\\<a X J 2 \\v\\. (2.2) 

Moreover, for the integer ks determined by \1. 7j ) with r > 2 there holds ks < ks- 

Proof. We first show that x 5 k & B p (x^) for all integers < k < ks. It is clear from 
(|1.10[) that this is true for k = 0. Now for any fixed integer < I < kg, we assume 
that x s k € Bp(x^) for all < k < I and we are going to show xi £ B p (x^). To this end, 
from the definition of {x s k } it follows that 

e{ +1 = a k (a k I + A^eo - (a k I + AD^F^xD* (F(x s k ) - y 5 - F'{x{)e{) . (2.3) 
Using the condition eo = F'(x*)*v, we can write 

e{ +l = a k (a k I + A)- 1 e + a k [(a k I + At)' 1 - {a k I + A)' 1 ] F'(x^)*v 
-(a k I + Alr'F'ixly (F(x s k ) -y s - F'(xl)e s k ) . 

Thus 

\\e{ +l - a k (a k I + A^eoW < \\a k [(a k I + Ai)' 1 - (a k I + A)' 1 ] F'(x^*v\\ 

: \\F(x s k )-y s -F'(x s k )et\\. (2.4) 
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\\F{xl)-y° -F\xl)el\\ < 5 + -L\\e° k \ 



<5||2 



(2.5) 



Moreover, note that 

a k [(akl + Aiy 1 - (akl + A)- 1 ] F'(^)*v 

= a k (a k I + At)- 1 (A - A s k )(a k I + A^F'^v 

= a k (a k I + Air'F'ixinF'i^) - F'{x{)){a k I + A)- x F'{x^)*v 

+a k (a k I + Al)- 1 (F'(x^y - F'{x{)*) F'{x^){a k I + A^F'^fv 

We then use (jl.lip to obtain 



\a k [(a k I + Air 1 - (a k I + A)' 1 ] F'(x^)*v\\ < 2L\\v\\ 



(2.6) 



Combining (f2l[)) , (|2"3)) and (|23)) gives 



\e s k+1 - a.iakl + Ar'eoW < 2L\\v\\\\e 5 k \\ + -±—L\\e s k \\ 2 + 

^Juk 2Jag 



Let 



Then we have 



Pk ■■= \\a k (a k I + A) 1 e 1| . 



||e£ +1 || <0 k + 2L\\v\\\\e 5 k \\ 



(2.7) 



<5 1 1 2 



2Jag 



(2.8) 



Note that for < k < kg we have 2 6 ■■ < ^-a 1 f / 2 \\v\\; note also that f3 k < ^a k ^\\v 



Wc thus obtain 



1 1 



2 2c r 



||4 +1 || < ( ^ + — ) al /2 \\v\\ + 2L\\v\\\\e d k \\ + ——L\\e d k \\ 2 . (2.9) 



5\\2 



This and (|1.5p imply 



H e fc+lll < r l/2 



1 1 

2 + 2c~ 



\v\\+2L\\v\\ 



fag 4 



-L 



IOL k 



By induction, (|1.12|) and e = F'(x t )*'i; we can show that if is sufficiently small 
then 

, , , 

(2-10) 



< r 1 / 2 ( 1 + -) \\v\\ forO<fc<L 

/Ok \ CQ J 



Combining this with l[2~%]) and noting that 2^ < 275HMI 1/2 <5 1/2 > 

we have for 

< k < I that 

||ei +1 ||</3 fc + -^||«|| 1 / 2 ( 5 1 /2 + CL|| V ||||ei||, 

where here and below C denotes a universal constant independent of 5 and k. Recall 
that (3 k < r/3fc+i which was proved in [3l Lemma 3.4]. By the smallness of we 
may apply Lemma 12.11 to conclude 



\e{\\<2p k + ^=\\v\\ 1 /H 1 ' 2 , 
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since, due to (|1.12[) . this is true for k — 0. Note that j3k < ||eo|| < f , the above 
inequality implies that x s k £ B p (x*) for all < k < I. We thus obtain x s k £ B p {x^) for 
all < k < kg. In the meanwhile, (|2.10p gives the desired estimates in (|2.2|) . 

In order to prove kg < kg, we note that the combination of (|2.9[) and (|2.10|) gives 

1 1 N 4 /2 |M| + CL|M|||4||. 



114+xll < 

Thus, by Lemma \2A\ 

H4ii<fi + 



2 2c 
1 



Co 



1 / 2 \\ ii 



for all < k < kg. 



This together with (fTTTT|) and ([23]) implies that 

€^ I+S V~ 1/2 y s ) 



<5 + 



1/2, 

its 



i 



-l\\4 

o 1 fe, 



<5 || 2 



<<5+ 1 + 



CO 



co 



I 



1 + — )coS + - 1+— coL||u||<S. 



Co 



Recall that r > 2 and < cq < r — 2, we can see for sufficiently small L\v\ there 
holds 



< tS. 



By the definition of kg, we thus conclude that kg < kg. 

Now we are ready to give the proof of Proposition 12.11 



□ 



Proof of Proposition [27T1 If kg = 0, then, by the definition of kg and (| 1 . 12[) . we 

have 

\\F(x )-y s \\<6. 
This together with gives 

||*V)eo|| < -V- *V)eo|| + \\F(x ) - y\\ 

<^IM| 2 + <*. 
Thus, by using eo = F'(x')*v, it follows 

II e II = (e ,F'(zt)*«) 1/2 = (fV)eo,«) 1/2 < ||FV)eo|| 1/a |M| 1/2 
^V^Rlleoll + lkH 172 ^ 2 - 
By the smallness of we obtain 

= ||eo|| < \\v\\W*. 

Therefore we may assume kg > in the following. Recall that in the proof of 
Lemma 12.21 we have obtained the following two estimates 

ll4 + xll<A + ||«|| 1/2 <5 1/2 + £||H|||e||| (2.11) 



The iteratively regularized Gauss-Newton method 
and 

for all < k < kg. 
Now we set 



(2-12) 



(3 s k := \\a k {a k I + AD^eol 
Then it follows from ((23)) that 

\Pk < K [(akl + Ai)- 1 - (akl + A)- 1 ] e || < 2£||i;|||| e J||. 

This together with (f2~TTj) and (j2~T2|) implies for small that 



< 



(2.13) 
(2.14) 



^ + ikir /2 ^ i/2 , 
ii^+iii^ + Ni 172 ^ 2 . 

We need to estimate (3 s k . We first have 

{Pi) 2 = (a k (a k I + A{)- x e ,a k {a k I + A{)- l F'[^Yv) 

= (a k (a k I + Alr'eo, a k (a k I + A 6 ,)- 1 [F'(x 5 k )* + (F'(x^)* - F'(x 5 k )*)] v) 

= (a 3 k /2 (a k I + B s k r^F'(xl)eo, a k /2 (a k I + B s k )-^v) 

+ (a k (a k I + Aiy'eo, a k (a k I + At)' 1 [F'(x^)* - F 1 (x k )*\ v) 
<li\\v\\+PiL\\v\\\\eil 



where 



Therefore 



it 



pi< 



3/2 



(a k I + Bir 3 / 2 F'(xi)e 



1/2 



L\\v\\ 



(2.15) 



In order to estimate 7^ , we observe that (|2.3j) implies 

a 3 k /2 (a k I + Bi)-^F'{x{)e = al /2 (a k I + B s k )-^B s k {F{x{) - y s - F'{x{)e{) 
+a 1 k /2 (a k I + Bi)- 1 / 2 F'(xi)e s k+1 . 

Thus 

' i /2 ( a a + ^)- 1 / 2 ^(4)e^ 1 || + ||F(4)-/-F'(xi)e^|| 

a^ 2 (a k I + B s k )- 1/2 (F(x{ +1 ) - y s ) || + || (F'(x s k+1 ) - F'(x{)) e{ +l \\ 

+ \\F(4+i) - V - F'{x s k+1 )e{ +l || + ||F(4) - y - F'(4)4|| + ^. 
It then follows from (|1.11[) that 



< 



al /2 (a k I + Bi)- 1 ' 2 (F(x s k+1 ) - y s ) + 25 + L\\e s k \\ 2 + 2L\\e s k+1 \\ 



Using [6, Proposition 3.4], and noting that 



L\\x 



fc+i 



411 <i (1141 



ifc+ll 



<L\\v\\a k /2 , 



we can conclude for sufficiently small L\\v\\ there holds 



a^i^I + Bi)- 1 ' 2 (F{x s k+1 )-y s ) 



< 



,1/2 



(a k I 



BU,)- 1 ' 2 (F(xi +1 )-y s ) 
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Let {E\} be the spectral family generated by the self-adjoint operator B 5 k+1 . Then, 
by using (|1.5p , we have 



a^iauI + Bt^y 1 ' 2 (F(x s k+1 )-y s ) 



<5\||2 



a k + A 



d\\E x (F(x k+1 )-y»)\\ 



< r 



Otk+l + A 



<5\||2 



d\\E x (F(x d k+1 ) - y d )\ 



al^iaik+il + B s k+1 



,-1/2 



(F(a 



k+l) 



Thus 



al /2 (a k I + Bt)- 1 ' 2 (F(x s k+1 ) - y s ) < a^a^I + B s k+i y^ 2 (F(x s k+1 ) y s ) 



1/2 



Therefore 



7l< 



1/2 



(a k+1 I + Bt^y 1 ' 2 (F(4 +1 ) -y A ) +S + L\\et\\ 2 + L\\e 5 k+1 \ 



This together with (|2.15|) gives 



1/2 

al^a^I + Bt^y^iFixUj-y*) \\v\\^ 



'fc+i 



II) 



+ \\v\y 2 si/ 2 + ^LM(H\\ 

Combining this with (|2T3|) and ([2T4]) yields 

1/2 

< "ilSK+i/ + ^+i)- 1/2 (F(x s k+1 ) y 5 ) Wvf/ 2 + WvfW 2 + yfLMP, 
Using the smallness of L\\v\\ we obtain 



< 



4/ + 2 1 (a fc+1 / + ^ +1 )- 1 /2 (n 4 +i) „^ ) M i/2 + M V2 5 i/* 



1/2 



It then follows from (|2.14[) that for all < k < k$ there holds 

1/2 

H\\<\\a^(a k I + B s k y^(F(4)-y s )\\ \\v\\ ^ + \\v\\VW*. 

Thus, by setting fc = fc<5 in the above inequality and using the definition of k$, we 
obtain the desired estimate. □ 



3. A key inequality 

The main result of this section is the following inequality. 

Proposition 3.1 Assume that U.10\) , and ll.lfty hold and that xq — x' — 

F'(x^)*v for some v g AfiF'^)*)- 1 . If L\\v\\ is sufficiently small, then for any integer 
kg < k < kg there holds 

||a^ 2 (a fc ,/ + B)-V2(F(^ j )-y)|| 



l|efe s 



< 



efc 



IOL k 



The proof of this result will employ Proposition ^. H and the following two auxiliary 
results which are of independent interest. 
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Lemma 3.1 Under the conditions in Provosition \3.1[ if L\\v\\ is sufficently small, 
then for all k > there hold 

x k eB p {x v ) and \\e k \\ < a£ 2 ||u||. (3.1) 
Moreover, for all integers < k < I there hold 

||e fc ||»/3 fc , ||e*-i||<||e fc || and \\ ei \\ < \\e k \\, (3.2) 
where (3 k is defined as in \2. 7| ). 

Proof. From the definition of {x k } it follows easily that 

e fe+1 = a k (a k I + A k y l e - (a k I + A k )- l F'{x k )* (F(x k ) -y- F'(x k )e k ) . (3.3) 

Then we can use the similar argument in the proof of Lemma 12.21 to conclude (|3.1[) 
and the estimate 

\\\e k+1 \\ - /3 k \ < \\e k+1 - a k (a k I + Ay'eoW < L\\v\\\\e k \\ (3.4) 
Thus, by Lemma \2. 11 we have 
INI < 2/3 fc . 

Note that (3 k is non-increasing, we can use (j3.4p again to obtain 

||efc+i|| >Pk- Ci||«||||e fc || > (1 - CL\\v\\)(3 k > (1 - CL\\v\\)0 k+1 . 

Therefore \\e k \\ w j3 k . As an immediate consequence, we have 
\\ei\\ < fa<(3 k < \\e k \\ 

for all < A; < I. In order to show 

l|e*-i|| < IKH, 
it suffices to show 

Pk-i < k - 

However, this last inequality has been verified in [21 Lemma 4.3]. □ 

Lemma 3.2 Under the conditions in Provosition \3.1[ if L\\v\\ is sufficiently small, 
then for all integers < k < k$ there hold 

Ik* -%k\\ < 



JOik 

Proof. By setting 

u k :=F(x k )-y-F'(x k )e k , u{ := F{x{) - y - F'{x{)e{, (3.5) 
it then follows from (|2.3[) and (|3 that 



where 



x i+i - x k+i = h + h + h + h, 



h :=a k [{a k I + A S k ) 1 - (a k I + A k ) e , 
I 2 := (a.I + Air'F'ixir^-y), 
h := [(a k I + A^F'ixkf - (a k I + A{)- l F'{x{) 
h ■= {a k I + A k )- x F'{x k )*{u k - u{). 



<5 \*~\ 

ki 
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It is clear that H/2II < 2^a k ' ^ n or der to estimate I\, recall that eo = F'(x^)*v, we 
can write 

h = a k [(a k I + Ai)- 1 - {a k I + At)- 1 ] F'(x k )*v 

+ a k [(a k I + At)- 1 - {ot k I + Ak)- 1 ] (F'(x^)* - F'{x k )*)v. 
We may use (|l.lip . the similar argument in deriving (|2.6p , and Lemma |3~T1 to obtain 

ll-fill % L \H\\x s k -x k \\ + -_ Z 2 ||*;||||e fc ||||4 -Xk\\ <i||«||||4-a:fc||. 
Similarly, for I3 we have 

iiisii < Ua.i+Air 1 [F'(xiy-F'(x k y]ui\\ 

+ I) [(a k I + At)- 1 - (a k I + A k )- X ] F'(x k )*ui\\ 

<—L\\ui\\\\4-x k \\ 
a k 



<-L 2 || e £|| 2 ||4-^ll 



a k 



< 



L||u||||a;f - x k \ 



By using (jl.lip , Lemma 13.11 and Lemma 12.21 we have 

ii/ 4 ii < ^=ik-«*ii 



<^(L||4-x fc || 2 + L|| e ^||||4-x fe ||) 



>ctk 



<^L(\\ei\\ + \\e k \\)\\xi-x k \\ 
< L\\v\\\\xi - x k \\. 

Combining the above estimates on I\, I2, 13 and I4 we conclude that there is a constant 
C independent of 5 and k such that for all < k < k$ 

-x k +i\\ < -r-= + CL\\v\\\\x s k -x k \\. 
2vafc 



Since L\\v\\ is small, an application of Lemma I2TT1 gives the desired estimates. □ 
Now we are in a position to prove Proposition [3TTJ 

Proof of Proposition 13.11 Let 

J := [(afe a _i(afc a -i/ + ^4) _1 - a k -i (a*-i/ + A)- 1 ] e . 
Then it follows from (|3.3p , (|1 . , and Lemma 13.11 that 
IN, -Xk\\ < \\J\\ + \\a kl -i K-iI + A,-i) _1 - (a kl -il + A)- 1 ] F'(x^)*v\\ 

+ ||a fc _i [(a fc _i/ + A^y 1 - (o fc _iJ + .4)- 1 ] F'(^)*v\\ 

\\F(x ks -i) -y- F'(x ks -i)e ks -i\\ 



.— = \\F(x k -i) -y- F'(x fe _i)e fe _i|| 
^a k -i 
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L|K-i|| 2 , L||e fc _i|| a 



< 



||J||+i|M| (||e fc ,_i|| + ||e fc _i||) + 



SIMI+LlMKIK-xll + \\e k -i\\). (3.6) 
In order to estimate J, we write 
J = Ji + J 2 + Ja, 

where 

Jl := (l-^^) (a k -xI + A)- } F'ir' } .Fin i - ,,). 
Ji ■■= I 1 





-l 




-l 




-l 




-l 


afc- 


-l 


a fe(S 


-l 



J 3 := 1 )(a k -iI + A) L A[a k5 ^i(a ks -iI + A) L e ~e k6 

By using the argument in the proof of [3l Lemma 4.4] we can see that 

Also, by using (|1.11[) and noting afc_x < afc 5 _i, it is easy to see that 

||J 2 ||<-^L|| efe5 || 2 . 
From Proposition 12.11 and Lemma 13.21 we have 

5 



e ks \\<\\ei\\ + \\xt s - Xks \\<\\v\\^5^ + 

^JOL k , 



Recall that ks < h which implies -^= < \\v\\ l / 2 5 1 / 2 . Thus 

ikii < ni i/2 * i/2 . 

Since k < h$ , we then obtain 



He*, 



L< ^^imi i/2 ^ i/2 < ni- 



y/C( k -l yja k -! 

Therefore 

WI<L|N||e fc J. 
By using (|3.4p . J3 can be estimated as 

ll-Zsll < ||afe5-i(a)b s -i-f + -A) _1 eo - e fc J < L\\v\\\\e k6 _i\\. 
Combining the above estimates on J\, J2 and J3, we obtain 

\\J\\ ^ p= « (ll e fcJ + e fc«-il 

This together with (|3.6p and (|3.2[) gives 

Ffcs -^fc $ " p= (ll e fcll + efej )• 

V"fe 



By the smallness of we thus conclude the proof. □ 
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4. Proof of Theorem ITTT1 

In this section we will complete the proof of the main result, Theorem 11.11 In order 
to apply Proposition ^. 11 we need the following estimates. 

Lemma 4.1 Assume that hl.lO]) . hi. 11)) and h!.12\) hold and that xo — x' = F'(x')*v 
for some v E Af(F'(x>)*) . Let kg be the integer determined by |1.7| j with r > 2. If 
L\\v\\ is sufficiently small, then we have 

||a fc ,(a fc5 / + B)- 1/2 (i ;i (x fe J-y)||<J 

and 

s<\\al /2 (a k i + B)-^ 2 (F(x k )-y)\\ 

for all < k < kg . 

Proof. For < k < kg we set 

a k := \\a k /2 (a k I + B)-^ 2 (F(x k ) - y)\\ 2 , 

b k := \\al /2 (a k I + B s k )-V 2 (F(x k )-y)f. 
It then follows from [6l Proposition 3.4] and Lemma [2~2l that 

\a k - b k \ < -^=L\\e s k \\(a k + b k ) < L\\v\\{a k + b k ). 

By the smallness of we have a k ~b k . Thus it suffices to show that 

y/bk s IS $ an( l $ \l°~k for < k < kg. 
By using (|1.11|) , Lemma 13.21 and (|2.ip we have for < k < kg 

Vh > \\a k /2 (a k I + Bi)- l / 2 {F{x{) - y 5 )\\ - \\F{x k ) - F{x{) - F\x{){x k - x{)\\ 

-Wa^iakl + Blr^F'ixDixk-xDW-S 

> (r- 1)6 - \\x k -4\\ -\L\\x k -x{f 

5 2 

> (t-2)S-CL— 

a k 

> {t - 2 - CL\\v\\)5, 

where C is a universal constant independent of S. Using r > 2 and the smallness of 
L\\v\\ we obtain 6 < V&fc for all < k < kg. 
Similarly, we have 



v^7 < (r + 1)4 + J£ ||x», - < || + -i||xj, - x t ,|| 2 
< 8. 

The proof is thus complete. □ 

Proof of Theorem 11.11 We first prove (| 1 . 13|) . Note that for k > kg, we have 
^= > coa^ 2 ||u||, while Lemma [2~2l implies that \\e ke \\ < aj^ 2 ||u||. Therefore, in order 
to complete the proof, it suffices to show 

Kll<inf{||e fc || + -^=:0<A<fc a 
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Note that for kg < k < kg, we have from Lemma 15721 Proposition 13.11 and Lemma |4~T1 
that 



114 ii < 



< 



< 



\ e k s 



efc 



l e fc| 



'Oiks 



\\al{ 2 (a ks I + 13)-^(F(x ks )-y)\\ , 5 



while for < k < kg we have from Lemma 1371] and Lemma I47T1 that 

ll<n<i| efc j + -L 



y/ a k s 

+ -^||4f-iK,-i^ + By^iFix^) - y) 



+ \\{a ks _ 1 I + B)- 1 l 2 {F{x k ^ 1 )-y)\\ 

+ \\(a k ^I + B)-^F^)e k ^\\ + Zl^& hA 

V a ks-1 

1 



y/ a k 5 -l 



L IMI||e fc ,-i 



The proof of (|1.13|) is complete. 



Next we prove (I1.14[) . Note that (3 k < a"J 2 \\u)\\ under the condition on xq — x 



- -t 



We have from Lemma [3~T1 that ||efc|| < a^ 2 ||w||. Thus it follows from (|1 . 13[) that 



, jl < inf \ a k /2 \\uj\\ + 



/a k 



fc = 0,l,- 



Now we introduce the integer kg such that 

s \ 2/(i+") 

IMI 

Then it is readily to see that 



<a k , < k < kg. 



H t \\ < < /2 IMl + -L= < |M| 1 /(i+*V/(i+"). 



□ 
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